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ABSTRACT 

The purpose of this paper is to examine the nature of 
discrepancy score phenomena of the Myers-Briggs Type Indicator 
(MBTI), as related to internal consistency and construct validity of 
the instrument. Data were collected from 140 university research 
managers. The data suggest internal consistency problems: only 37,3 
percent of the subjects produced internally consistent scores. From 
the examination of the discrepancy scores in this real world sample, 
a judgment is offered about interpretation and use of MBTI data 
containing discrepant scores in light of the Jungian theory 
undergirding the MBTI. (PN) 



********************************************************************* 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 

********************************************************************* 



The Myers-Brfggs Type Indicator: 
Analysts of discrepancy score phenomenon 
tn a real world sample 



/ 



Randy L, Hoover 
Nancy Kadunc " 
The Ohio State University 



UK. DW MT M B IT Of OUCATIOH 

NATIONAL INtTTTUTE Of EDUCATION 
EDUCATIONAL RESOURCES INFORMATION 

CENTER (ERIC) 
QL Thej document has bean reproduced as 
received from the person or ofoenitetion 
originating it. 
G Max* changes have i^en made to improve 
reproduction quefity. 

• Points of view or optnione stated in this docu- 
ment do not neceeaenry r e pr ae en t official NtE 
poamon or poacy. 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



A/ IC^Um^ 



Paper presented at American Educational 
Research Association meeting, April 15» 
1983, Montreal, Canada 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERJCL" 



PRINTED IN THE UNITED STATES OF AMERICA 



2 



t 



The purpose of this paper 1s to examine the nature of discrepancy 
score phenomena of the Myers-Briggs Type Indicator (MBTI) as related to 
internal consistency and construct validity of the instrument. From the 
examination of the discrepancy scores in a real world. sample, a judgment 
will be offered about Interpretation and use of MBTI data containing 
discrepant scores In light of the Jungian theory undergoing the MBTI. 

Overview of the Problem 

The MBTI produces a preference scores for each of the four aspects 
of personality it attempts to measure. The net result is an overall 
score which is intended to reflect the preference an individual shows 
for one of sixteen personality types as defined by the interpretation of 
Jung's (1921/1971) theory of psychological type by the originators of 
the instrument (McCaulley, 1977). The overall type reported on the MBTI 
is determined by scores on two sub-tests of the instrument-a word-pair 
section and a word-phrase section. 

If we consider the overall type profile in light of the profiles of 
type established by scores on the individual sub-tests, then it is 
possible and, I think, desirable to seek illumination of the meaning of 
discrepant scores. It is important at this point to distinguish between 
measures of internal consistency given in the form of split-half 
reliabilities (MBTI, 1962; 1957; Myers, 1962) and those given in the 
form of discrepancy scores. 

Myers (1962) reports that split-half reliabilities are determined 
by splitting each index (E-I; S-N; T-F; J-P) in half and pursuing 
Gilford's (1954) recommendations for a logically-split-half procedure. 
However, because the splitting is across sub-tests, the procedure does 
not allow comparison of sub-test scores as indication of internal 
consistency. 
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The MBTI manual (Myers, 1962) notes appropriately that there 1s a 
problem 1n ascertaining the reliability of the MBTI due to the nature of 
the construct(s) the Instrument 1s attempting to measure vis a vis the 
nature of the Individual being assessed. 

More than with most other tests, perhaps, the 
experimenter ^ faced with the question of how much of any 
given result is the reliability of the indicator and how 
much is the reliability of the person taking it. The 
potent but as yet unmeasureable variable of "type 
development"... enters every equation as an unknown 
quantity. Also unknown is the mean level of type 
development for any of the various samples that are 
tested,' and how many individuals in each should be 
expected to be answering virtually at random because 
their type is insufficiently developed to govern their 
responses (p. 19). 

This comparison of instrument reliability to subject reliability, 
although seemingly inane at first glance, does reflect the possibility 
of the subject's developmental condition belying the overall reliability 
of the instrument. Ironically, the very construct which MBTI attempts 
to measure, psychological type, can serve to blur the actual internal 
consistency in terms of statistical reliability when the psychological 
type of the subject is developmental ly undifferentiated. But that is a 
point for discussion later. Therefore, the caveat in the manual (Myers, 
1962) dealing with use of statistical measures of reliability should be 
noted explicitly. 
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(1)t seems more realistic not to attempt to derive "the" 
reliability of the Indicator from item statistics (p. 19) 
In spite of the aforementioned caveat to statistical reliability, 
split-half reliabilities are reported In the manual and appear credible 
(.75 or higher) for the instrument when level of development (age data) 
is considered. In this sense, the MBTI can and probably should be 
considered to have auoquate statistical, split-half reliability. 
However, in clinical or counseling settings where M = 1, a measure of 
internal consistency may be of considerable importance to the clinician 
or counselor such that ordinary statistical measures of reliability are 
insufficient for the confidence level necessary for Interpretation and 
prescription. However, an interesting view of internal consistency is 
afforded through the report of discrepancy scores. 

Discrepancy scores are obtained by comparing the score for each 
index (E-I; N-S; T-F; J-P) as determined from the word-pair and 
word-phrase subtests. This is done by calculating a preference score 
for each index on both subtests and noting zero as discrepancy score If 
the letter part is the same on both subtests for a given index. If the 
letter part is not identical on both subtests for a given index, the 
preference scores are added together and noted (McCaulley & Myers, 
1977). While the specific discrepancy score seems to have little 
meaning beyond being the sum of two separate preference scores, the 
notion that a given individual is characterized as being of one 
psychological type on one subtest and a different psychological type on 
the other suggests value in examining the phenomenon in light 
theoretical constructs upon which MBTI is based. It should also be 
noted that it is in fact possible for an individual to score as three 
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different psychological types when consideration 1s given to th« 
possiblity of both subtest scores and overall score differing. 
Method . 

Kadunc (1982) sought to examine two questions regarding validation 
of a conceptual model dealing with characteristics of research and 
development organizations and characteristics of project managers. The 
first question examined the nature of the relationship between project 
and organizational characteristics preferred by project managers and 
their psychological types. The second examined the relationship between 
managers as decision makers and psychological type. Data were collected 
from 140 research managers affiliated with university educational 
research and non-profit educational regional labs. A total of 276 
subjects were asked to participate, of which 140 returned usable data. 
The MBTI was used as the measure of psychological type and was scored 
for discrepancy among overall" type, word-pair type, and word-phrase 
type. 

The data from MBTI were examined to allow breakdown of overall 
score, word-pair score, and word-phrase score; frequency of discrepancy; 
overall type on pair; overall type on phrase; and discrepancy score 
preference strength. The Kadunc study collected and examined data 
dealing with discrepancy scores in order to gain insight about the 
frequency and comparative nature of discrepancy score phenomenon in 
conjunction with this writer, not as any direct function of testing her 
hypotheses. 

The direction for such examination comes from three places. First 
is this writers interest and work in the application of Jung's work to 
education. Second is this writers role as a consultant to Kadunc in 



terms of the Junglan dimensions of her study. Third Is g«nuin« concern 
about the construct validity and Internal consistency of the MBTI 
relative to the subtest and overall scores. The segue Into examination 
of the nature of the discrepancy score phenomenon from these Initial 
positions Is provided In the MBTI scoring breakdown sheet (McCaulley & 
Hyers, 1977) when It Is noted that discrepancy scoring gives an estimate 
of Internal consistency. 

The data presented In table-1 show frequency breakdowns among those 
subjects In the sample who had: ' a) no discrepancy score, b) discrepancy 
between word-pair and overall, c) discrepancy between word-phrase and 
overall and, d) discrepancy among overall, word-pair, and word-phrase. 



Insert table-1 about here 



When the issue of internal consistency of the MBTI is addressed in 
terms of frequency of discrepancy scores, the data from this sample 
suggest that there may be problems with internal consistency. Table-1 
indicates that only 37.3% of the subjects in the sample had overall 
scores which were consistent with both word-pair and word-phrase subtest 
scores. While 52.9% had an overall score which was consistent with 
either the word-pair or word-phrase score, slightly less than 10% of the 
subjects failed to show any consistency-word-pair, word-phrase, and 
overall type were different. 

As a measure of location of discrepancy scores, table-2, frequency 
of discrepancy as a function of the four measures of personality type 
tells us that discrepancy scores in this sample accrue in relative 
proportions as a function of the particular personality dimension being 
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Measured. That Is to say that discrepancy scores on the E-I dimenslo 
occurjid in 30* of the sample cases and three times more often than S-l 
discrepancies. Likewise, discrepancy scores on either T-F or J- 
occurred 1n 20* of the cases and twice as often as S-N discrepancies 



Insert table-2 about here 



Since the Initial problem Is centered In the need to understand 
better the Internal consistency of the MBTI vis a vis discrepancy score 
phenomenon In order to explore construct validity of the HBTI, the 
results of this most rudimentary analysis of the data need illumination 
from the undergirding theory of C.G. Jung. This should not belle the 
need for further data analysis regarding discrepancy scores, however, 
data analysis can be meaningless without appropriate theoretical 
framework. Hence a re-examination of Jungian theory is appropriate In 
order to continue empirical analysis of discrepancy score phenomenon. 
Discussion 

The first and most appropriate step in exploring the meaning of 
data which indicate that only 37.3% of the subjects produced scores 
which were internally consistent, is to refer back to the claim in the 
MBTI manual that type development may mediate reliability of responses. 
The assumption of type development is based soundly within Jung's 
theory. The essence of type development exists in Jung's (1913/1971; 
1921/1971; 1923/1971; 1931/1971; 1936/1971) theory of psychological 
types and has been explicated in Gifts differing (Myers, 1980) which 
addresses psychological type in terms of the MBTI. 
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The notion of type development Is tied to the Idea that the 
formation of personality is a direct function of the degree to which the 
four functions are capable of conscious, directed operation by that 
Individual. This conscious, directed use of the functions Is a product 
of their differentiation (Jung, 1921). Further, unless the functions 
are relatively differentiated, direction is precluded. On the subject 
of differentiation Jung (1921/1971) comments: 

To the extent that a function is largely or wholly 
unconscious, it is also undifferentiated; it is not only 
fused together in its parts but also merged with other 
functions. Differentiation consists in the reparation of 
its individual parts from each other. Without 
differentiation direction is impossible, since the 
direction of ^ function towards a goal depends on the 
elimination of anything irrelevant. Fusion with the 
irrelevant precludes direction; only a differentiated 
function is capable of being directed, (p. 424-5). 
Differentiation of psychological functions is subsumed under, and a 
necessary condition for individuation (Jung, 1921/1971; 1939/1959; 
1934/1950/1959). Individuation is explicitly a developmental 
phenomenon. Relating to both differentiation and subsequent formation 
of personality, Jung (1921/1979) describes this developmental construct 

in the following terms: 

In general, it is the process by which individual beings 
are formed and differentiated; in particular, it is the 
development of the psychological individual as being 
distinct from the general, collective psychology. 
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Individuation, therefore, is a process of differentiation 
having for its goal tha development of tha individual 
parsonality. (p. 448). 
Restating tha typa davalopnant hypothasis as a possibla explanation 
for frequency of discrepancy scores we would say: If subjects of a 
given sample have failed to achieve differentiation among their 
functions, then their scores would be discrepant. There are three 
rudimentary, descriptive statistics which can serve as high inference 
indicators for exploring the development hypothesis: • respondent age, 
educational attainment, .and split-half reliability trends across age and 
educational attainment. 

By comparing subject age and education with split-half reliability 
trends we actually view internal consistency as a function of subject 
reliability (Myers, 1962). More specifically, we seek to find out 
whether or not subject reliability is possibly related to variables of 

0 

age and education. The data presented in the MBTI suggest that 
split-half reliability coefficients do increase as age and intellectual 
ability of subjects increase. On the theoretical side, Jung (1928/1953; 
1934/1954) would support the notion that age a..d education serve to 
facilitate differentiation and therefore, type development. 

The data in this sample suggest that the development hypothesis is 
without merit at high inference level. The mean age of the sample is 
43.06 years with a range of 26-66 and standard deviation of 8.52 
(females X = 40.95 range = 26-66, S.D. = 8.70, males X = 44.05, range = 
36-64, S.O. = 8.31). These descriptive data are hardly suggestive of 
poorly developed type when consideration is given to split-half 
reliabilities in the MBTI manual which are .75 or higher for populations 
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ranging frtm Jr. high students through colltgt undergraduates, 
likewise, tht Itvtl of educational attainment of tht saaple ustd In th1$ 
study 1$ predominantly Ph.O. or higher is 1nd1cittd 1n table-3. 



Instrt Ublt-3 about htn 



Jung's thtory of psychological typos 1s tht undorglrdlng construct 
for tht MBTI (Myers, 1962; 1980). Tht Instrument 1s cltarly an atttmpt 
to mtasure Jung's construct, htnct 1t 1s not surprising that tht manual 
rtlatts rtl1abH1ty probltiis to tht notion of typo developmsnt. 
Although tht manual dots not dtal with tht 1ssut of dlscrtpancy scores, 
tht scoring breakdown rtport shttt for tht MBTI notts: 

Som counstlors rtport that parsons with largt 
dlscrtpancy scorts txptrltnct ttnslon 1n tht expression 
of tht prtftrtnct with tht dlscrtpancy. Ont possibility 
is that tht ptrson trlts to appaar to othtrs Hkt tht 
phrase-question prtftrtnct, but wlshts to hold the 
word-pai r prtftrtnct. (McCaul 1 ty 4 My trs , 1977) . 
This stateaent seeas to imply that tht word-phrast subttst 1s more 
amenable to manipulation by the rtspondtnt. If this 1s tht case, than 
we need to examine tht nature of tht two subttsts in light of the data 
and Junglan theory. Our data (table-1) indicate that the frequency of 
discrepancy scores was less between overall and word-phrase than between 
overali and word-pair, i.e., phrase scores wart aort ofttn congrutnt 
with overall scort than ware word-pair scorts. In addition, thtrt setas 
to be tacit support for the idea that if individuals want to nanipulate 
the MBTI outcome in the direction of the way they wish to appear, it is 
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tisitr to "ftt through" tht senttncts of tht word-phrase fiction thin 
the Ifoltttd word of tht word-pair ttctlon. 

Tht data furtly 1nd1cttt thtt tht discrepancy phenomenon If rttl 
for th1$ sample. Likewise thtrt 1$ some suggestion which hints tt 
support for tht somewhat cryptic comments from counselors about ptoplt 
trying to manipulate thtlr tpptirtnct through tht word-phrase subtest. 
In addition, thtrt 1$ a Junglan construct rtlattd to psychological typt, 
but distinct In Its own form, which aay strvt to build a hypothttlcal 
txplanatlon for dlscrtpancy scort phenomenon. • 

Jung's construct of Persona (1928/1953; 1940/1950/1959) provldts an 
1nttrtst1ng fit to tht problti. Jung compares tht parsons to Its 
original meaning whtn 1t was a task worn by actors to indicate tht rolt 
btlng playtd. Jung wrltts: 

Fundamentally tht ptrsona 1s nothing real; 1t 1s a 
compromise bttwttn Individual and sodtty as to what a 
nan should apptar to bt. Ht takes a nana, tarns a tltla, 
rtprtstnts an office, ht Is this or that. In a cartaln 
stnst all this 1s real, ytt in rtlation to tha assantlal 
individuality of tht ptrson concerned it 1s only a 
stcondary reality, a product of compromise, 1n taking 
which othtrs often have a greater share than he. The 
persona is a semblance, a two-dimensional rtality to give 
it a nickname, (p. 155-6). 
Persona in this sense becotes the living definition of how we wish to be 
seen--a rather unconscious self-presentation that is a function of our 
occupation, role, and expectations of significant others. The eterging 
hypothesis for discrepancy score phenomenon suggests a relationship 
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between the choice of response on the MBTI and the way and individual 
prefers to be pictured rather than psychological type preference. 
Oieter Wyss (1961/1973) describes the essence of Jung's 'persona' when 
he writes: 

The persona concept is not only supposed to define the 
character of the individual, it is also supposed to 
embrace his function in the community as well.... A 
doctor, for example, is said to have a typical 'persona', 
i.e. his particular professional manner, the same as a 
parson or counter clerk. Jung's observation that this 
manner is determined to a considerable degree by the 
expectations of the community— which would, for example, 
expect a parson to behave with dignity and decorum— is a 
true one. (p. 330). 
Consider now that this sample represents project managers who were 
asked to participate in a research study (Kadunc, 1982) intended to 
examine hypotheses relating to managerial style, decision making 
characteristics, and psychological type. Further, subjects were asked 
to fill out a questionnaire dealing with their work role in addition to 
completing the MBTI. Taking Jung's construct of persona as a 
theoretical perspective, an alternative hypothesis regarding discrepancy 
scores emerges: If subjects of a given sample have strong personas 
which mask and are incongruent with their psychological type, then their 
MBTI scores will be discrepant. 

The essence of this hypothesis, from the standpoint of Jungian 
theory, is that persona can be seen as having its own "type" 
characteristics which when incongruent with innate psychological type 
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may serve to mask the actual predisposition of the respondent. Again, 
when consideration is given to the nature of the sample used in this 
study in particular or to use of MBTI in association with career and 
occupation in general, Jung's (1940/1950/1959) comments about persona 

and profession seem salient: 

Every calling or profession, for example has its own 

characteristic persona One could" say, with a 

little exaggeration, that the persona is that which in 
reality one is not, but which oneself as well as others 
think one is. In any case the temptation to be what one 
seems to be is great, because the persona is usually 
rewarded in cash. (p. 123). 
It is important to note that while the data do not support the persona 
notion with any great degree of confidence, there is some -suggestion 
that this alternative to the development hypothesis may be tenable 
enough such that analysis for lower inference confidence may be 
warranted. 

Hypotheses aside, the data clearly indicate one very important 
issue and raise another. The most important issue from the data is the 
need to score M8TI for discrepancies. Regardless of the uncertainty 
about the nature of discrepancy scores, they do exist in this sample and 
must be seen as problematic. Ramifications for any counseling be it 
career, psychological, or other are serious when decisions are made 
based wholly or in part on the MBTI overall score. These data suggest 
that a judgment that overall score is accurate when discrepancy scores 
are unknown is not merited. These data also suggest that MBTI publish 
discrepancy score data along with split-half reliabilities. If no other 
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item of interest emerges from this study, let the discrepancy score 
phenomenon serve as a firm caveat to those using the HBTI in N = 1 
situations. 

Explicit in the persona explanation for discrepancy scores is the 
notion that persona effect may be a mediating variable in the assessment 
of psychological type. Implicit in the persona Hypothesis is the issue 
of construct validity. While split-half reliabilities given in the MBTI 
manual seem to indicate a reasonable level of internal consistency, the 
discrepancy scores in this sample seem to indicate an unreasonable level 
of internal consistency. If the person hypothesis is found to be 
significant, it could mean that either the instrument is "transparent" 
or that there is a problem with the construct being measured. From the 
standpoint of Jungian theory we must question the degree to which 
persona manifests its."type characteristics" on an instrument such as 
the MBTI. If persona effects are strong enough, it is entirely 
possible, theoretically, that the MBTI overall score is representative 
of psychological type only when persona "type" is congruent with actual 
psychological type. Thus, these data with a little push from the theory 
of C.G. Jung may serve to raise serious issues as to construct validity 
vis a vis psychological type, persona type, or interaction between both 
constructs. 
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Table-1 

Frequency and percentage for comb tnat tons 
of overall test and subtest scores 
Combination Frequency Percentage 



Overall, pair, and phrase the same 


50 


37.3 


Overall and pair the same 


29 


21.6 


Overall and phrase the same 


k2 


31.3 


All different 


13 


09.7 


Total 


13*» 


99.9 
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Table-2 

Percentage of non- discrepant and discrepant scores 
by the four psychological type dimensions 



Dimension 


Non-discrepant 


Olscrepant 


Extravers Ion- Introvers 1 on 


69.9 


30.1 


Sensing- Intuition 


89.7 


10.3 


Thlnklng-feellng 


78.7 


21.3 


Judg 1 ng- perce 1 v 1 ng 


78.7 


21.3 



N - 136 
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Table-3 

Frequency and percentage of sample data 
by educat tonal attainment levels 



Educational level 


Male 


Female 


I Ota i 


% Total 


OiCnOlvr 9 


0 


2 


2 


01.4 


Master's 


2 


2 




02.9 


Master's + 


8 


8 


lo 


11 U 
1 1 .*t 


Ph.D. 


76 


29 


105 


75.0 


Ph.D. + 


9 


k 


13 


09.3 


Total 


95 




140 


100.0 
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